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RISK,  AMBIGUITY,  AND  TllU  RAVAGE  AXIOMS* 

7?//  Daniel  ELLsnEiio 

I.  Are  there  unrertaiiiticH  Oiat  are  not  risks'’  000.  -II.  Pneerlaiiities  (hat 
are  not  risks,  000.  —  III.  Why  are  some  uiicertaintii'S  not  rtsks?  — 000. 

I.  Are  3’hkre  Uncertainties  That  .\re  Not  Bisks? 

There  has  always  Ix'eii  a  good  deal  of  skeplieisin  about  the 
behavioral  sigiiifieaiice  of  Prank  Kiiigh  ’s  distiiietioii  tad  ween  “mea.s- 
urable  uncertainty”  or  “risk,”  which  may  be  reiire.senti'd  tiy  nunieri- 
cal  probabilities,  and  “nniiu'asnrable  niiccrtainty”  which  cannot-. 
Knight  maintaiiK'd  that  tlie  latter  “nncertaiiity”  jirevailed  —  and 
hence  that  numerical  probatiilil  ies  were  inapplicalile  —  in  situations 
when  the  decision-maker  was  ignorant  of  the  .statistical  freiiuencies 
of  events  relevant  to  his  decision;  or  when  a  jiriori  calcnlatioms  were 
impo.ssible;  or  when  the  relevant  events  were  in  some  sen.se  nnicine; 
or  when  an  important,  once-and-for-all  decision  was  conci'rned.’ 

*  Research  for  thi.s  papi-r  was  done  us  a  member  of  the  Society  of  Fellows, 
Harvard  University,  I!I.")7.  It  was  delivered  in  es.s('ntially  its  ])resent  form, 
except  for  Section  III,  at  the  December  meetings  of  the  Fconoimdrie  Society, 
St.  Louis,  ItKiO.  In  the  recent  revision  of  .Section  III.  I  have  been  particularly 
stimulated  by  discussions  with  A.  kladansky,  T.  Sehelling,  L.  Shapley  and  S. 
Winter. 

1.  F.  II.  Knight,  Ris/c.  Unrertainiy  and  Profit  (Iloston:  Houghton  Mifflin, 
1921).  But  see  Arrow’s  comment :  “  In  brief,  Knight's  uncertainties  seem  to  have 
surprisingly  many  of  the  properties  of  ordinary  probabilities,  and  it  is  not  clear 
how  much  is  gained  by  the  distinction.  .  .  .Actually,  his  uncertainties  produce 
about  the  same  reactions  in  imlividuals  as  other  writers  ascribe  to  lisks.’’  K.  .1. 
Arrow,  “Alternative  .Approachi'S  to  the  Theory  of  Choice  in  liisU-taking  Situa¬ 
tions,”  Ecmiomtlrica,  Vol.  1!)  (Uct.  1951),  pp.  417,  420. 

Yet  the  feeling  ha.s  persi.sted  that,  even  in  these  situations,  jicople 
tend  to  behave  “as  though”  they  assigned  nnmericai  probabilities,  or 
“degrees  of  belief,”  to  the  events  imiiinging  on  their  tictions.  How¬ 
ever,  it  is  hard  either  to  confirm  or  to  deny  .snclt  a  jiroposition  in  the 
absence  of  precisely-defined  procedures  for  measuritKj  the.se  alleged 
“degrees  of  belief.” 

What  might  it  mean  operationally,  in  terms  of  refntatile  predic¬ 
tions  about  observable  phenomena,  to  .say  that  someone  behaves  “as 
if”  he  assigncci  quantitative  likelihoods  to  ev'ents:  or  to  say  that  he 
does  not?  An  intuitive  an.swer  may  emerge  if  we  consider  an  example 
proposed  by  Shackle,  who  takes  an  extreme  form  of  the  Knightian 
position  that  statistical  information  on  frequencies  within  a  large, 
repetitive  class  of  events  is  strictly  irrelevant  to  a  decision  whose 
outcome  depends  on  a  single  trial.  Shackle  not  only  rejects  numerical 
probabilities  for  representing  the  uncertainty  in  this  .situation;  he 
maintains  that  in  sitmitious  where  all  the  potential  outcomes  seem 
“perfectly  possible”  in  the  sense  that  they  would  not  violate  accepted 
laws  and  thus  cause  “surprise,”  it  is  impossible  to  distinguish  mean¬ 
ingfully  (i.e.,  in  terms  of  a  person’s  behavior,  or  any  other  ob.serva- 
tions)  between  the  relative  “likelihoods”  of  these  outcomes.  In  throw¬ 
ing  a  die,  for  instance,  it  would  not  surprise  us  at  all  if  an  ace  came  up 
on  a  single  trial,  nor  if,  on  the  other  hand,  some  other  number  came 
up.  So  Shackle  concludes: 

Suppose  the  captains  in  a  Test  Match  have  agreed  that  instead  of  tossing  a  coin 
for  a  choice  of  innings  they  will  decide  the  matter  by  this  next  throw  of  a  die,  and 
that  if  it  shows  an  ace  .Australia  shall  bat  first,  if  any  other  number,  then  England 
shall  bat  first.  Can  we  now  give  any  meaningful  answer  whatever  to  the  ques¬ 
tion,  “Who  will  bat  first'?”  e.xeept  “  We  do  not  know?”^ 

2.  G.  L.  S.  Shackle,  Uncertainty  m  Economics  (London:  Cambridge  Lbii- 
versity  Press,  1955),  j).  8.  If  this  example  were  not  typical  of  a  number  of 
Shackle’s  works,  it  would  seem  almost  unfair  to  cite  it,  since  it  ajipears  so  trans¬ 
parently  inconsistent  with  commonly-observed  behavior.  Can  Shackle  really 
believe  that  an  .Australian  ca|)tain  who  cared  about  batting  first  would  be  indifier- 
ent  between  staking  this  outcome  on  “heads”  or  on  an  ace? 

Mo.st  of  ITS  might  think  we  could  give,  better  answers  than  that. 
We  could  sa}’,  “England  will  tiat  first,”  or  more  cautiously:  “I  think 
England  will  probably  bat  first.”  And  if  Shackle  chtdlenges  us  a.s  to 
\vhat  we  “mean”  by  that  statement,  it  is  (juite  natural  to  reply: 
“We’ll  bet  on  England;  and  we’ll  give  you  good  odds.” 

It  so  happems  that  in  this  ca.se  statistical  information  (on  the 
behavior  of  dice)  is  available  tind  does  seem  relevant  even  to  a 
“single  shot”  decision,  our  bet;  it  will  affect  the  odds  we  offer.  As 
Damon  Runyon  once  said,  “The  race  i.s  not  always  to  the  swift  nor 
the  battle  to  the  strong,  but  that’s  the  way  to  bet.”  However,  it  is 
our  bet  itself,  and  not  the  reasoning  and  evidence  thiit  lies  behind  it, 
that  gives  operational  meaning  to  our  statement  that  ive  find  one 
outcome  “more  likely”  than  another.  And  we  may  be  willing  to 
place  bets  —  thus  revealing  “degrees  of  belief”  in  :i  quantitative 
form  —  about  events  for  which  there  is  no  statistical  information  at 
all,  or  regarding  which  statistical  information  seems  in  principle 
unobtainable.  If  our  pattern  of  bets  were  suitably  orderly  —  if  it 
satisfied  certain  postulated  constraints  —  it  would  be  possible  to 
infer  for  ourselves  numerical  sulijective  probabilities  for  events,  in 
terms  of  which  some  future  decisions  could  be  predicted  or  described. 
Thus  a  good  deal  —  perhaps  all  —  of  Knight’s  class  of  “unmeasurable 
uncertainties”  would  have  succumbed  to  measurement,  and  “risk” 
would  prevail  instead  of  “uncertainty.” 

A  number  of  sets  of  constraints  on  c'hoice-behavior  under  uncer¬ 
tainty  have  now  been  proposed,  all  more  or  less  equivalent  or  closely 
similar  in  spirit,  having  the  implication  that  —  for  a  “rational”  man 
• —  all  uncertainties  can  be  reduced  to  risks}  Their  flavor  is  suggested 
by  Ramsay’s  early  notions  that,  “The  degree  of  a  belief  is  .  .  .  the 
extent  to  which  we  are  prepared  to  act  upon  it,”  and  “The  probaliility 
of  1/3  is  clearly  related  to  the  kind  of  belief  which  would  lead  to  a  bet 

3.  F.  P.  Ramsey,  “Truth  and  Probability”  (1!)26)  in  The  Foundations  of 
Mathematics  and  Other  Loyical  Essays,  ed.  R.  B.  Brait.hwaite  (New  York:  Har- 
court  Brace,  1 93 1  i ;  L.  ,J.  Savage,  The  Foundations  of  Statistics  (New  York :  lYiley, 
1954);  B.  de  Finetti,  “Recent  Sugge.stions  for  the  Reconciliation  of  Theories  of 
Probability,”  pj).  217-26  of  Froceedinijs  of  the  Second  {WoO)  Berkeley  Symposium 
on  Mathematical  Statistics  and  Probability,  Berkeley,  1951  ;  P.  Siippos,  1).  David¬ 
son,  and  S.  Siogel,  Dccision-M akiny  (Stanford  University  Press,  1957).  Closely 
related  approaches,  in  which  individual  choice  behavior  is  irresuined  to  be  stochas¬ 
tic,  have  been  developed  by  11.  D.  Luce,  Individual  Choice  Behavior  (New  York: 
Wiley,  1959),  and  J.  S.  C’hipman,  “Stochastic  Choice  and  Subjective  I’robability,” 
in  Decisions,  Values  and  Groups,  ed.  D.  Willnor  (New  York:  I’erg  unon  Press, 
1960).  Althongli  the  argument  in  this  paper  .applies  equally  well  to  these  latter 
stochastic,  axiom  systems,  they  will  not  be  discussed  explicitly. 

4.  Ramsey,  op.  cit.,  p.  171. 

of  2  to  1.”^  Starting  from  tlie  notion  that  gamliliiig  choices  are 
iiiflueii(;ed  by,  or  “reflect,”  dilTering  degrees  of  belief,  thi.s  approach 
sets  out  to  infer  tho.se  Ixdiefs  from  the  actual  ehoiees.  Of  eour.se,  in 
general  tho.se  elioices  reveal  not  only  the  iiersoii’s  relative  expecta¬ 
tions  Init  his  ridat-ive  prefi'reiiees  for  oufeomes;  there  is  a  problem  of 
di.stiiigiiishiiig  between  these.  But  if  one  picks  the  right  ehoiees  to 
oli.serve,  and  if  tlie  Savage  postulates  or  some  eiiuivalent  set  are 
found  to  tie  .satisfied,  this  distinction  can  be  made  iinamliiguously, 
and  eit-her  ((uidittitive  or,  ideally,  numerical  prolitdiilities  can  be 
determined,  d'he  prupouiiders  of  these  axioms  tend  to  be  huiiefiil 
thiit  the  rules  vill  lie  commonly  satisfied,  iif.  least  roughly  :uul  most 
of  the  time,  because  they  regtird  tliese  iiostulates  as  normative 
maxims,  widely-:ieeeptal)le  priiieiples  of  riitional  behavior.  In  other 
words,  peoiile  should  tend  f.o  behave  in  the  iiostulated  fashion,  l)ee;uise 
that  is  the  way  tliey  would  want  to  behave.  At  the  least,  these  axioms 
are  believed  to  jiredict  certain  clioiees  tluit  pi'ople  will  imike  when 
they  take  plenty  of  time  to  reflect  over  their  decision,  in  fhe  liglit  of 
the  postuhites. 
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In  considering  only  deliherate  (leeisi(jns,  then,  does  this  leave 
any  room  at  all  for  “iinmeasurahle  uncertainty”:  for  uncertainties 
not  reducible  to  “risks,”  to  quantitative  or  ([ualitative  probabilities? 

A  side  effect  of  the  axiomatic  ap])roach  is  that  it  supplies,  at 
last  (as  Knight  did  not),  a  useful  o|)erational  meaning  to  the  projjosi- 
tion  that  people  do  7iot  always  assign,  or  act  “as  thougli”  they 
assigned,  probabilities  to  uncertain  events.  The  meaning  vvo\ild  be 
that  with  respect  to  certain  events  they  did  not  obey,  nor  did  they 
wish  to  obey  —  even  on  reflection  —  Savage’s  postidates  or  eriuivalent 
rules.  One  could  emphasize  here  either  that  the  postulates  failed  to 
be  acceptable  in  tho.se  circumstances  as  normative  rules,  or  that 
they  failed  to  predict  reflective  choices;  I  tend  to  be  more  interested 
in  the  latter  aspect.  Savage  no  doubt  in  the  former.  (A  third  infer¬ 
ence,  which  H.  Kaifia  Jayors,  could  be  that  people  need  more  drill  on 
the  importance  of  conforming  to  the  Savage  axioms.)  But  from 
either  point  of  view,  it  would  follow  that  there  would  he  simply  no  way 
to  infer  meaningful  probabilities  for  those  events  from  their  choices,  and 
theories  which  purported  to  describe  their  uncertainty  in  terms  of 
probabilities  would  be  (juite  inapplicalile  in  that  area  (unless  quite 
different  operations  for  measuring  probability  were  devised).  A  fore- 
over,  such  people  could  not  be  described  as  maximizing  the  mathe¬ 
matical  expectation  of  utility  on  the  basis  of  numerical  probabilities 
for  those  events  derived  on  any  basis.  Nor  would  it  be  possible  to 
derive  numerical  “von  Neumann-AIorgenstern”  utilities  from  their 
choices  among  gambles  involving  those  events. 

I  propose  to  indicate  a  class  of  choice-situations  in  which  many 
otherwise  reasonable  people  neither  wish  nor  tend  to  conform  to  the 
Savage  postulates,  nor  to  the  other  axiom  sets  that  have  been  devi.sed. 
But  the  implications  of  such  a  finding,  if  time,  are  not  wholly  destruc¬ 
tive.  First,  both  the  predictive  and  normative  u.se  of  the  Savage  or 
equivalent  postulates  might  be  improved  by  avoitling  attempts  to 
apply  them  in  certain,  specifiable  circumstances  where  they  do  not 
seem  acceptable.  Second,  we  might  hope  that  it  is  prc'ci.sely  in  such 
circumstances  that  certain  proposals  for  alternative  decision  rules  and 
nonprobabilistic  descriptions  of  uncertainty  (e.g.,  by  Knight,  Shackle, 
Wald  and  Hurwicz)  and  might  prove  fruitful.  I  believe,  in  fact,  that 
this  is  the  case. 

II.  Uncert.-\inties  Th.\t  Are  Not  Risks 

Which  of  two  events,  a,  does  an  individual  consider  “more 
likely”?  In  the  Ramsay-Savage  approach,  the  basic  te.st  is:  On 
which  event  would  he  prefer  to  stake  a  prize,  or  to  place  a  given  bet?  By 
the  phrase,  “to  offer  a  bet  on  a”  we  shall  mean:  to  make  available  an 
action  with  consetiuence  a  if  a  occurs  (or,  as  Savage  puts  it,  if  a 
“obtains”)  and  b  if  a  does  not  occur  (i.e.,  if  d,  or  “not-a”  occurs), 
where  a  is  preferable  to  b. 

Suppose,  then,  that  we  offer  a  subject  alternative  bets  “on”  a 
and  “on”  /3  {a,  need  not  be  either  mutually  exclusive  or  exhaustive, 
but  for  convenience  we  shall  assume  in  all  illustrations  that  they  are 
mutually  exclusive). 

Events 

a  /3  dniS 

I 

Gambles 

II 

The  Ramsay-Savage  proposal  is  to  interpret  the  person’s  prefer¬ 
ence  between  I  and  II  as  revealing  the  relative  likelihood  he  assigns 
to  a  and  /3.  If  he  does  not  definitely  prefer  II  to  I,  it  is  to  be  inferred 
that  he  regards  a  as  “not  less  probable  than”  /3,  which  we  will  write: 
a  ^  /3. 

For  example,  in  the  case  of  Shackle’s  illustration,  we  might  be 
allowed  to  bet  either  that  England  will  bat  first  or  that  .Australia  will 
(these  two  events  being  complementary),  staking  a  $10  prize  in 
either  case: 


I 
II 

If  the  event  were  to  be  determined  by  the  toss  of  a  die,  England  to 
bat  first  if  any  number  but  an  ace  turned  up,  /  would  strongly  prefer 
gamble  J  (and  if  Shackle  should  really  claim  indifference  between  I 
and  II,  1  would  be  anxious  to  make  a  side  bet  with  him),  if,  on  the 
other  hand,  the  caiitains  were  to  toss  a  coin,  I  would  be  indifferent 
between  the  two  bets.  In  the  first  case  an  observer  might  infer,  on 
the  basis  of  the  Ramsey-Savage  axioms,  that  I  regarded  England  as 
more  likely  to  bat  first  than  Australia  (or,  an  a('e  as  less  likely  than 
not  to  come  up) ;  in  the  second  case,  that  I  regarded  heads  and  tails 
as  “eciually  likely.” 

I  hat  inference  would,  in  fact,  bo  a  little  hasty.  My  indifference 
in  the  second  case  would  indeed  indicate  that  1  assigned  ecjual  prob¬ 
abilities  to  heatls  and  tails,  if  I  assigned  any  prohabiliiies  at  all  to  those 
events;  but  the  latter  condition  would  remain  to  be  proved,  and  it 
would  take  further  choices  to  prove  it.  I  might,  for  e.xample,  be  a, 
“minimaxer,”  whose  iiulifference  between  the  two  bets  merely 
reflected  the  fact  that  their  respective  “worst  outcomes”  wore  identi¬ 
cal.  To  rule  out  such  possibilities,  it  would  be  noces.sary  to  examine 
my  pattern  of  preferences  in  a  number  of  well-chosen  cases,  in  the 
light  of  certain  axiomatic  constraints. 


England  first  Australia  first 


$10 

$0 

$0 

.$10 

a 

b 

b 

h 

a 

h 
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In  order  for  any  relationshii?^among  events  to  luive  the  prop¬ 
erties  of  a  “(lualitutive  i)rot)ahility  relationship,”  it  must  i)e  true  that: 

(a) (^is  a  complete  ordering  over  events;  for  any  two  events 
a,  P,  cither  a  is  “not  less  piadadde  than”  15,  or  15  is  “not  less  probal)le 
than”  a,  and  if  a  ^  d  and  (3^7,  then  a  ^  7. 

(b)  If  a  is  more  probable  than  /3,  tlien  “not-a”  (or,  d)  is  less 
probable  than  not-/3  (fi) ;  if  a  is  etpudly  probable  to  d,  and  /5  is  eciually 
probable  to  (5,  then  a  is  e(]ually  probable  to  /3. 

(c)  If  a  and  7  are  mutually  exclusive,  and  so  are  /3  and  7  (i.e., 

if  apiT  =  I^Dy  =  ^)i  more  probable  than  /5,  then  the 

union  (aU  7)  is  more  prol)at)le  than  (jSUj}. 

Savage  proves  that  the  relationshiil^^mong  events,  inferred 
as  above  from  choices  among  gambles,  will  have  the  above  properties 
if  the  individual’s  pattern  of  choices  obeys  certain  postulates.  To 
indicate  some  of  these  briefly: 

PI :  Complete  ordering  of  gambles,  or  “actions.”  In,  the  exam¬ 
ple  below  either  1,  is  preferred  to  II,  II  is  preferred  to  I,  or  I  and  II 
are  indifferent.  If  I  is  preferred  to  II,  and  II  is  preferred  or  indiffer¬ 
ent  to  III,  then  I  is  preferred  to  III  (not  shown). 

a  (3  df)^ 


I 

II 


a 

b 

b  ' 

b 

a 

b 

P2:  The  choice  between  two  actions  must  be  unaffected  by  the 
value  of  pay-offs  corresponding  to  events  for  which  both  actions  have 
the  same  pay-off  (i.e.,  by  the  value  of  pay-offs  in  a  constant  column). 
Thus,  if  the  subject  preferred  I  to  II  in  the  example  above,  he  should 
prefer  III  to  IV,  below,  when  a  and  b  are  unchanged  and  a  takes  any 
value; 


a 

50/3 

III 

a 

c 

IV 

b 

a 

c 

This  corresponds  to  Savage’s  Postulate  2,  which  he,  calls,  the 
“Sure-thing  Principle”  and  which  bears  great  weight  in  the  analysis. 
One  rationale  for  iGamounts  to  the  following:  Suppose  that  a  person 
would  not  prefer  IV  to  III  if  he  knew  that  the  third  column  would 
not  “obtain”;  if,  on  the  other  hand,  he  knew  that  the  third  column 
wovld  obtain,  he  would  still  not  prefer  IV  to  III,  since  the  pay-offs 
(whatever  they  are)  are  equal.  So,  since  he  would  not  prefer  IV  to 
III  “in  either  event,”  he  should  not  prefer  IV  when  he  does  not  know 
whether  or  not  the  third  column  will  obtain. 

“Except  possibly  for  the  assumption  of  simple  ordering,”  Savage 
asserts,  “I  know  of  no  other  extralogical  principle  governing  decisions 
that  finds  such  ready  acceptance.”® 

5.  Op.  cit.,  p.  21.  Savage  notes  that  the  principle,  in  the  form  of  the  ration¬ 
ale  above,  “cannot  appropriately  be  accepted  as  a  postulate  in  the  sense  that  PI 
is,  because  it  would  introduce  new  undetined  technical  terms  referring  to  knowl¬ 
edge  and  possibility  that  would  render  it  mathematically  useless  without  still 
more  postulates  governing  these  terms.”  He  substitutes  for  it  a  postulate  cor¬ 
responding  to  P2  above  as  e.xpressing  the  same  intuitive  constraint.  Savage’s  P2 
corresponds  closely  to  “Rubin’s  Postulate”  (Luce  and  Raiffa,  Games  and  Deci¬ 
sions;  New  York:  Wiley,  1957,  p.  290)  or  Milnor’s  “Column  Linearity”  postulate, 
ibid.,  p.  297,  which  imply  that  adding  a  constant  to  a  column  of  pay-offs  should 
not  change  the  preference  ordering  among  acts. 

If  numerical  probabilities  were  assumed  known,  so  that  the  subject  were 
dealing  explicitly  with  known  “risks,”  these  postulates  would  amount  to  Samuel- 
son’s  “Special  Independence  Assumption”  (“Probability,  Utility,  and  the  Inde¬ 
pendence  A.xiom,”  Econometrica,  Vol.  20  (Oct.  1952),  pp.  070-78,  on  which 
Samuelson  relies  heavily  in  his  derivation  of  “von  Neumann-Morgenstern  utilities.” 

P4:  The  choice  in  the  above  example  must  be  independent  of 
the  values  of  a  and  b,  given  their  ordering.  Thus,  preferring  I  to  II, 
the  subject  should  prefer  V  to  VI  below,  when  d  >  e: 


a 

“0/3 

V 

d 

e 

e 

VI 

d 

e 

This  is  Savage’s  Postulate  4,  the  independence  of  probabilities  and 
pay-offs.  Roughly,  it  specifies  that  the  choice  of  event  on  which  a 
person  prefers  to  stake  a  prize  should  not  be  affected  by  the  size  of 
the  prize. 

In  combination  with  a  “noncontroversial”  Postulate  P3  (cor¬ 
responding  to  “admissibility,”  the  rejection  of  dominated  actions), 
these  four  postulates,  if  generally  satisfied  by  the  individual’s  choices, 
imply  that  his  preference  for  I  over  II  (or  III  oyer  IV,  or  V  over  VI) 
may  safely  be  interpreted  as  sufficient  evidence  that  he  regards  a  as 
“not  less  probable  than”  /3;  the  relationship  “not  less  probable  than” 
thus  operationally  defined,  will  have  all  the  properties  of  a  “qualitative 
probability  relationship.”  (Other  postulates,  which  will  not  be  con¬ 
sidered  here,  are  necessary  in  order  to  establish  nmnerical  probabili¬ 
ties.)  In  general,  as  one  ponders  these  postulates  and  tests  them 
introspectively  in  a  variety  of  hypothetical  situations,  they  do  indeed 
appear  plausible.  That  is  to  .say  that  they  do  .seem  to  have  wide 
validity  as  normative  criteria  (for  me,  as  well  as  for  Savage) ;  they 
are  probably®  roughly  accurate  in  predicting  certain  aspects  of  actual 

6.  I  bet. 

choice  behavior  in  many  situations  and  better  yet  in  predicting  reflec¬ 
tive  behavior  in  tho.se  situations.  To  the  extent  this  is  truedt  should 
be  i)OS.sible  to  infer  from  certain  gambling  choices  in  tho.s^Jtuations 
at  lea.st  a  qualitative  probability  relationship  over  events,  correspond¬ 
ing  to  a  given  person’s  “degrees  of  belief.” 

Let  us  now  consider  some  situations  in  which  the  Savage  axioms 
do  not  .seem  so  plausible:  circumstances  in  which  none  of  the  above 
conclusions  may  appear  valid. 

Consider  the  following  hypothetical  experiment.  Let  us  .sui)po.se 
that  you  confront  two  urns  containing  red  and  black  balls,  from  one 
of  which  a  ball  will  be  drawn  at  random.  To  “bet  on  Rcdi”  will 
mean  that  you  choo.se  to  draw  from  Unii’;  and  that  you  will  receive 
a  prize  a  (say  .|100)  if  you  draw  a  red  ball  (“if  Rodi  occurs”)  and  a 
smaller  amount  b  (say,  .|0)  if  you  draw  a  black  (“if  not-Red[  occurs”). 

You  have  the  following  information.  Urn  I  contains  100  red  and 
black  balls,  but  in  a  ratio  entirely  unknown  to  you;  there  may  be 
from  0  to  100  red  balls.  In  Urn  II,  you  confirm  that  there  are  exactly 
50  red  and  50  black  balls.  An  ob.server  —  who,  let  us  say,  is  ignorant 
of  the  state  of  your  information  about  the  urns  —  sets  out  to  measure 
your  subjective  probabilities  by  interrogating  you  as  to  your  preler- 
euces  in  the  following  pairs  of  gambles; 
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1.  “Whieh  do  you  prefer  to  t>et,  on,  Redi  or  Black,:  or  are  you 
inddlerentf  Thai  is,  drawing  a  hall  from  Urn  I,  on  which  “event” 
do  you  prefer  the  *100  stake,  red  or  black:  or  do  you  care? 

2.  “Which  would  you  prefer  to  hot  on,  Red,,  or  Black,,?” 

3.  “Which  do  you  prefer  to  het  on.  Red,  or  Red,,?”' 

4.  “Which  do  you  iirefer  to  het  on.  Black,  or  Black,,?  ’* 

Let  us  sipipose  that  in  both  the  first  case  and  the  second  case 
you  are  indiiierent  (the  typical  resiionse).*  Judging  fron;  a  large 

frn,  I  y"'*  a  color  and  an  urn 

11,  t’u-illT  >>cforehand  as  to  the  full  set  of  gambles 

that  will  be  onered.  If  these  eomhtions  were  altered  (as  in  some  of  H  Hailfa’s 

I'linnhirreoh 'r  f ‘‘"'■’’w  ™>'lomized  strategies,  such  as 
yoiir  choices  to  bet  on  in  Urn  I.  which  mighf  affect 

8.  See  immediately  preceding  note. 

“real  life ’'T  '‘‘V'm h.vpothetical  e.vperiments.  In 

real  hfe,  y  ou  would  probably  turn  out  to  have  a  profound  color  preference  that 

show  up  OIK,  by  one  as  the  experimentation  progressed  inconclusively 

However,  the  results  in  Chipiuan’s  almost  identical  e.xperiment'  (op.  cit., 

pp.  8,-SS)  do  give  strong  su|,port  to  this  lindiiig;  Chipman’s  explanatory  hypoth¬ 
esis  dilfers  from  that  |,ropoS(>d  below.  “  f  anaiory  nypotu 

number  of  respon.ses,  under  absolutely  nonexperimental  conditioms, 
your  answers  to  these  last  two  iiuestions  are  likely  to  fall  into  one  of 
three  groups.  \  on  m.iy  still  be  indifferent  within  each  pair  of  options. 
(If  so,  you  may  sit  back  now  and  watch  for  awhile.)  But  if  you  are 
in  the  majority,  you  will  report  that  you  prefer  to  bet  on  Red,,  rather 
than  Red,,  and  Black,,  rather  than  Bl.ick,.  The  preferences  of  a 
small  minority  run  the  other  way,  preferring  bets  on  Red,  to  Redn 
and  Black,  to  Black,,. 

If  you  are  m  either  of  the.se  latter  groups,  you  are  now  in  trouble 
with  the  Savage  axioms. 

Supijose  that,  betting  on  red,  you  preferred  to  draw  out  of  Urn 
II.  An  observer,  ai^plying  the  basic  rule  of  the  Ramsay-Savage 
approach,  would  infer  tentatively  that  you  regarded  Red,,,  as  “more 
probable  than”  Red,.  He  then  ob, serves  that  you  also  prefer  to  het 
on  ack,,  rather  than  Black,.  Since  he  cannot  conclude  that  you 
regard  Red,,  as  more  probable  than  Red,  and,  at  the  same  time 
not-Red,i  as  more  probable  than  not-Red,  -  this  being  inconsistent 
with  the  essential  properties  of  probability  relationships  —  he  must 
conclude  that  your  choices  are  not  revealing  judgments  of  “prob¬ 
ability”  at  all.  So  far  as  these  events  are  concerned,  it  is  impossible 
to  infer  probabilities  from  your  choices;  you  must  inevitably  be 
violating  some  of  the  Savage  axioms  (specifically,  Pf  and  P2,  com¬ 
plete  ordering  of  actions  or  the  Sure-thing  Principle).* 

The  same  applies  if  you  preferred  to  bet  on  Red,  and  Black, 
rather  than  Red,,  or  Black,,.  Moreover,  harking  back  to  your  earlier 
(hypothetical)  replies,  any  one  of  these  preferences  involves  you  in 
conflict  with  the  axioms.  For  if  one  is  to  interpret  from  your  answers 
to  the  first  two  questions  that  Red,  is  “equally  likely”  to  not-Red,, 
and  Red,,  is  equally  likely  to  not-Red,,,  then  Red,  (or  Black,)  should 
Je  equally  likely  to  Red[i  (or  to  Blackfi),  and  any  preference  for 
drawing  from  one  urn  over  the  other  leads  to  a  contradiction.^ 

1.  In  order  to  relate  these  choices  clearly  to  the  postulates,  let  us  change 
the  experunental  setting  slightly.  Let  us  assume  that  the  balls  in  Urn  I  are  each 
marked  with  a  I  and  the  balls  m  Urn  II  with  a  If;  the  contents  of  both  urns  are 
then  dumped  into  a  single  urn,  which  then  contains  50  Red,,  balls,  50  Black 
balls,  and  lOJ  Red,  and  Black,  balls  in  unknown  proportion  (or  in  a  proportion 

indicated  only  by  a  simall  random  sample,  say.  one  red  and  one  black).  The  fol¬ 
lowing  actions  are  to  be  considered: 

100  50  50 


I 

II 

III 

IV 
V 

VI 


R, 

a 

b 

h 

b 

a 

b 


b 

a 

b 

b 

a 

b 


R,, 

6 

b 

a 

b 

b 

a 


B 


'II 

b 

b 

b 

a 

b 

a 


Let  us  assume  that  a  person  is  indifferent  between  I  and  II  (between  betting  on 
R  or  Bj),  and  between  III  and  IV  and  between  V  and  VI.  It  would  then  follow 
froni  Postulates  1  and  2,  the  assumption  of  a  complete  ordering  of  actions  and 
the  Sure-lhing  Principle,  that  I,  II.  HI  and  IV  are  all  indifferent  to  each  other. 

lo  indicate  the  nature  of  the  proof,  suppose  that  I  is  preferred  to  III  (the 
person  prefers  to  bet  on  R,  rather  than  R„),  Postulates  1  and  2  imply  that 
certain  transformations  can  be  performed  on  this  pair  of  actions  without  ajfecting 
their  preference  ordering;  specifically,  one  action  can  be  replaced  by  an  action 
indifferent  to  it  (Pi  -  ^mplete  ordering)  and  the  value  oL  consLt  cotZ 
can  be  changed  (P2  —  Sure-thing  Principle). 

tin.  f ‘If  ^  performing  such  “admissible  transforma¬ 

tions  It  would  follow  from  Pi  and  P2  that  the /irsl  action  in  each  of  the  following 
pairs  should  be  preferred:  ® 


I 

Ri 

Bii 

Rll 

BlI 

a 

b 

6 

b 

III 

b 

b 

a 

b 

r 

a 

b 

b 

a 

III' 

b 

b 

a 

a 

i" 

a 

b 

b 

a 

IIT' 

a 

a 

b 

b 

V" 

b 

b 

b 

a 

HI'" 

b 

a 

b 

h 

P2 


PI 


P2 


PI 


I"''  b  b  a  b 

,  HI""  a  b  b  b 

•» ^ 

2.  See  immediately  preceding  note. 

It  might  be  objected  that  the  assumed  total  ignorance  of  the 
ratio  of  red  and  black  bails  in  Urn  I  is  an  unrealistic  condition,  lead¬ 
ing  to  erratic  decisions.  Let  us  suppose  instead  that  you  have  been 
allowed  to  draw  a  random  .sample  of  two  balls  from  Urn  I,  and  that 
you  have  drawn  one  red  and  one  black.  Or  a  sample  of  four:  two  red 
and  two  black.  Such  conditions  do  not  seem  to  change  the  observed 
pattern  of  choices  appreciably  (although  the  reluctance  to  draw  from 
IRii  I  goes  down  somewhat,  as  shown  for  example,  by  the  amount  a 
subject  will  pay  to  draw  from  Urn  I ;  this  still  remains  well  below  what 
he  will  pay  for  Urn  11).  I  he  .same  conflicts  with  the  axioms  appear. 

Long  after  beginning  the.se  observations,  I  discovered  recently 
that  Knight  had  postulated  an  identical  comparison,  between  a  man 
who  knows  that  there  are  red  and  black  balls  in  an  urn  but  is  ignorant 
of  the  numbers  of  each,  and  another  who  knows  their  exact  propor¬ 
tion.  The  results  indicated  above  directly  contradict  Knight’s  own 
intuition  about  the  situation:  “It  must  be  admitted  that  practically, 
if  any  decision  as  to  conduct  is  involved,  such  as  a  wager,  the  first 
man  would  have  to  act  on  the  supposition  that  the  chances  are  eiiual.”* 
If  indeed  people  were  compelled  to  act  on  the  basis  of  some  Rrinciple 
of  Insufficient  Reason  when  they  lacked  statistical  information,  there 

would  be  little  interest  in  Knight’s  own  distinctions  between  risk  and 
uncertainly  so  far  as  conduct  were  involved.  But  as  many  people 
[iredict  their  own  conduct  in  such  hypothetical  situations,  they  do 
not.  feel  obliged  to  act  ‘his  if”  they  assigned  probabilities  at  all,  equal 
or  not,  in  this  state  of  ignorance. 

Another  example  yields  a  direct  test  of  one  of  the  Savage  postu¬ 
lates.  Imagine  an  urn  known  to  contain  30  red  balls  and  (>()  black 
and  yellow  balls,  the  latter  in  unknown  proportion.  (.Mteriiatively, 
imagine  that  a  sample  of  two  drawn  from  the  00  black  and  yellow 
balls  has  resulted  in  one  black  and  one  yellow.)  One  ball  is  to  be 
drawn  at  random  from  the  urn;  the  following  actions  are  considered: 

30  00 


Yellow 

*0 


Red  Black 

I  *100  *0 

II  *0  ,*100  .*0 

Action  I  is  “a  bet  on  red,”  II  is  “a  bet  on  black.”  Which  do  you  prefer? 


9/>K 
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Now  consider  the  following  two  actions,  under  the  same  cir- 


cumstances: 

30 

60 

Red 

Black 

Yellow 

III 

1100 

10 

$100 

IV 

10 

8100 

$100 

Action  III  is  a  “bet  on  red  or  yellow” ;  IV  is  a  “bet  on  black  or  yellow.” 
Which  of  these  do  yon  prefer?  Take  your  time! 

A  very  freciuent  pattern  of  response  is:  action  I  preferred  to  II, 
and  IV  preferred  to  III.  Less  frequent  is:  II  preferred  to  I,  and  III 
preferred  to  IV.  Both  of  the.se,  of  course,  violate  the  Sure-thing 
Principle,  which  requires  the  ordering  of  I  to  II  to  be  preserved  in 
III  and  IV  (since  the  two  pairs  differ  only  in  their  third  column, 
constant  for  each  pair).**  The  first  pattern,  for  example,  implies  that 

^3.  Knight,  op.  cit.,  p.  219. 

4.  Kenneth  Arrow  has  suggested  the  following  example,  in  the  spirit  of  the 
above  one: 

100  50  50 


Ri 

Rji 

Bn 

I 

a 

a 

h 

6 

II 

a 

b 

a  b 

III 

h 

a 

b 

a 

IV 

h 

b 

a 

a 

Assume  that  I  is  indifferent  to  IV,  II  is  indifferent  to  III.  Suppose  that  I 
is  preferred  to  II;  what  is  the  ordering  of  III  and  IV?  If  III  is  not  preferred  to 
IV,  P2,  the  Sure-thing  Principle  is  violated.  If  IV  is  not  preferred  to  III,  PI, 
complete  ordering  of  actions,  is  violated.  (If  III  is  indifferent  to  IV,  both  PI  and 
P2  are  violated.) 

the  subject  prefers  to  bet  “on”  red  rather  than  “on”  black;  and  he 
also  prefers  to  bet  “against”  red  rather  than  “against”  black.  A 
relationship  “more  likely  than”  inferred  from  his  choices  would  fail 
condition  (b)  above  of  a  “(lualitative  probability  relationship,”  since 
it  would  indicate  that  he  regarded  red  as  more  likely  than  black,  but 
also  “not-red”  as  more  likely  than  “not-black.”  Moreover,  he  would 
be  acting  “as  though”  he  regarded  “red  or  yellow”  as  less  likely  than 
“black  or  yellow,”  although  red  were  more  likely  than  black,  and 
red,  yellow  and  black  were  mutually  exclusive,  thus  violating  con¬ 
dition  (c)  above. 

Once  again,  it  is  impos.sible,  on  the  basis  of  such  choices,  to  infer 
even  qualitative  probabilities  for  the  events  in  question  (specifically, 
for  events  that  include  yellow  or  black,  but  not  both).  Moreover, 
for  any  values  of  the  pay-offs,  it  is  impossible  to  find  probability 
numbers  in  terms  of  which  these  choices  could  be  described  —  even 
roughly  or  approximately  —  as  maximizing  the  mathematical  expec¬ 
tation  of  utility.® 

5,  Let  the  utility  pay-offs  corresponding  to  $100  .and  .$0  be  1,  0;  let  Pi,  P-i, 
Pz  be  the  probabilities  corresponding  to  red,  yellow,  black.  The  expected  value 
to  action  I  is  then  Pu  to  II,  P-i,  to  III,  Pi  -t-  Ps;  to  IV,  Pz  +  Pz.  But  there  are 
no  P’s,  P;  :>  0,  2Pj  =  1,  such  that  P,  >  Pj  and  Pi  +  Pz  <  Pi  -b  Pz- 

You  might  now  pause  to  reconsider  your  replies.  If  you  should 
repent  of  your  violations  —  if  you  should  decide  that  your  choices 
implying  conflicts  with  the  axio.ns  were  “mistakes”  and  that  your 
“real”  preferences,  upon  reflection,  involve  no  such  inconsistencies  — 
you  confirm  that  the  Savage  postulates  are,  if  not  descriptive  rules 
for  you,  your  normative  criteria  in  these  situations.  But  this  is  by  no 
means  a  universal  reaction;  on  the  contrary,  it  would  be  exceptional. 

Responses  do  vary.  There  are  those  who  do  not  violate  the 
axioms,  or  say  they  won’t,  even  in  these  situations  (e.g.,  G.  Debreu, 
R.  Schlaiffer,  P.  Samuelson);  such  subjects  tend  to  apply  the  axioms 
rather  than  their  intuition,  and  when  in  doubt,  to  apply  some  form 
of  the  Principle  of  Insufficient  Reason.  Some  violate  the  axioms 
cheerfully,  even  with  gusto  (J.  Marschak,  N.  Dalkey);  others  sadly 
but  persistently,  having  looked  into  their  hearts,  found  conflicts  with 
the  a.xioms  and  decided,  in  Samuelson’s  phra.se,®  to  satisfy  their 
preferences  and  let  the  a.xioms  satisfy  themselves.  Still  others  (II. 

6.  P.  Samuelson,  “ITob.ability  .and  the  .Utenipts  to  Measure  Utility,”  The 
Economic  Review  (Tokyo,  Japan),  July  1950,  pp.  109-70. 

To  test  the  predictive  eileetiveness  of  the  axioms  (or  of  the  alternate  deci¬ 
sion  rule  to  be  proposed  in  the  next  section)  in  these  siluatiotis,  cont  rolled  e.xpcri- 
raentation  is  in  order.  (See  Chipman’s  ingenious  experiment,  op.  cit.)  But,  as 
Savage  remarks  {pp.  cit.,  p.  28),  tlie  mode  of  iuterrogatlou  implied  here  and  in 
Savage’s  book,  iisking“the  person  not  how  he  feels,  but,  what  he  woukl  do  in  such 
and  such  a  situation”  and  giving  him  ample  opportunity  to  ponder  the  implica¬ 
tions  of  his  replies,  seems  iiuite  appropriate  in  weighing  “the  theory's  more 
important  normative  interpretation.”  Moreover,  these  noiiexperimental  observa¬ 
tions  can  have  at  least  negative  empirical  implications,  since  there  is  a  presump¬ 
tion  that  people  whose  instinctive  choices  violate  the  Savage  axioms,  and  who 
claim  upon  further  reflection  that  they  do  not  want  to  obey  them,  do  not  lend  to 
obey  them  normally  in  such  situations. 

Ruiffa)  tend,  intuitively,  to  violate  the  axioms  but  fool  guilty  about 
it  and  go  back  into  hu’ther  analysis. 

The  important  finding  is  that,  after  rethinking  all  their  “offeud- 
iiig”  decisions  in  the  light  of  the  axioms,  a  number  of  people  who  are 
not  only  sophisticated  but  reasonable  decide  that  they  wish  to  persist 
in  their  choices.  'Lhis  includes  people  who  previously  felt  a  “first- 
order  commitment”  to  the  axioms,  many  of  them  suiqiri.sed  and  some 
dismayed  to  find  that  they  wished,  in  these  situations,  to  violate  the 
Sure-thiiig  Principle.  Since  this  group  included  L.  .1.  ravage,  when 
last  tested  by  me  (I  have  been  reluctant  to  try  him  again),  it  .seems 
to  deserve  respectful  consideration. 
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III.  Why  .\ue  Some  Unceut.unttes  Not  Risk.s? 

Inilividiiiils  who  would  choose  I  over  II  and  IV  over  III  in  the 
example  above  (or,  II  over  I  and  III  over  IV)  are  simply  not  acting 
“as  though’’  they  assigned  numerical  or  evcm  (lualitative  probabilities 
to  the  events  in  (piostion.  'Fherc^  are,  it  turns  out,  other  ways  for 
them  to  act..  Hut  what  arc  th(\v  <loing? 

Even  with  so  f(nv  observations,  it.  is  possible  to  say  some  other 
things  they  are  nol  doing.  'Fhey  are  not  “minimaxing’’ ;  nor  are  they 
applying  a  “Ibirwic^z  criterion,’’  maximizing  a  weighted  avi'rage  of 
minimum  pay-off  and  maximum  tor  each  strategy.  If  they  were 
following  any  such  rules  they  woidd  have  been  imlifferent  between 
each  pair  of  garni  lies,  sinc'c  all  have  identical  minima  and  maxima. 
IMoreover,  they  are  not  “minimaxing  regret,’’  since  in  terms  of 
“regrets”  the  pairs  l-II  and  III-IV  are  identical.^ 

7.  No  one  whose  decisions  were  l)nsecl  on  “regrets”  eonld  violate  the  Snre- 
thing  Principle,  since  all  constant  columns  of  pay-offs  would  transform  to  a  column 
of  O’s  in  terms  of  “regret”;  on  the  other  hand,  such  a  person  would  violate  PI, 
complete  ordering  of  strategies. 

Thus,  none  of  the  familiar  criteria  for  predicting  or  prescribing 
decision-making  under  uncertainty  corresponds  to  this  pattern  of 
choices.  Yet  the  choices  themselves  do  not  appear  to  be  careless  or 
random.  They  are  persistent,  reportedly  deliberate,  and  they  seem 
to  predominate  empirically;  many  of  the  people  who  take  them  are 
eminently  reasonable,  and  they  insist  that  they  want  to  behave  this 
way,  even  though  they  may  be  generally  respectful  of  the  Savage 
axioms.  There  are  strong  indications,  in  other  words,  not  merely  of 
the  existence  of  reliable  patterns  of  blind  behavior  but  of  the  opera¬ 
tion  of  definite  normative  criteria,  different  from  and  conflicting  with 
the  familiar  ones,  to  which  these  people  are  trying  to  conform.  If  we 
are  talking  about  you,  among  others,  we  might  call  on  your  introspec¬ 
tion  once  again.  What  did  you  think  you  were  doing?  What  were 
you  trying  to  do? 

One  thing  to  be  explained  is  the  fact  that  you  probably  would 
not  violate  the  axioms  in  certain  other  situations.  In  the  urn  example, 
although  a  person’s  choices  may  not  allow  us  to  infer  a  probability 
for  yellow,  or  for  (red  or  black),  we  may  be  able  to  deduce  quite 
definitely  that  he  regards  (yellow  or  black)  as  “more  likely  than”  red; 
in  fact,  we  might  be  able  to  arrive  at  cpiite  precise  numerical  estimates 
for  his  probabilities,  approximating  2/3,  1  '3.  What  is  the  difference 
between  these  uncertainties,  that  leads  to  such  different  behavior? 

Responses  from  confe.ssed  violators  indicate  that  the  difference 
is  not  to  be  found  in  terms  of  the  two  factors  commonly  used  to 
determine  a  choice  situation,  the  relative  desirability  of  the  possible 
pay-offs  and  the  relative  likelihood  of  the  events  affecting  them,  but 
in  a  third  dimension  of  the  problem  of  choice:  the  nature  of  one’s 
information  concerning  the  relative  likelihood  of  events.  What  is  at 
is.sue  might  be  called  the  ambiguity  of  this  information,  a  /ffiality 
depending  on  the  amount,  type,  reliability  and  “unanimity  of 
information,  and  giving  rise  to  one’s  degree  of  “confidence”  m  an 
estimate  of  relative  likelihoods. 

Such  rules  as  minimaxing,  maximaxing,  Ilurwicz  criteria  or 
minimaxing  regret  are  usually  prescribed  for  situations  of  “complete 
ignorance,”  in  which  a  decision-maker  lacks  any  information  what¬ 
ever  on  relative  likelihoods.  This  would  be  a  case  in  our  urn  example 
if  a  subject  had  no  basis  for  considering  any  of  the  possible  prob¬ 
ability  distributions  over  red,  yellow,  black  —  such  as  (1,0,0),  (0,1,0), 
—  as  a  better  estimate,  or  basis  for  decision,  than  any  other. 
On  the  other  hand,  the  Savage  axioms,  and  the  general  “Bayesian” 
approach,  are  unquestionably  appropriate  when  a  subject  is  willing  to 
base  his  decisions  on  a  definite  and  precise  choice  of  a  particular  distri¬ 
bution;  his  uncertainty  in  such  a  situation  is  unequivocally  in  the 
form  of  “risk.” 

But  the  state  of  information  in  our  urn  example  can  be  charac¬ 
terized  neither  as  “ignorance”  nor  “risk”  in  these  senses.  Each  sub¬ 
ject  does  know  enough  about  the  problem  to  rule  out  a  number  of 
possible  distributions,  including  all  three  mentioned  above.  He  knows 
(by  the  terms  of  the  experiment)  that  there  are  red  balls  in  the  urn; 
in  fact,  he  knows  that  exactly  1  '3  of  the  balls  are  red.  Thus,  in  his 
“choice”  of  a  subjective  probability  distribution  over  red,  yellow, 
black  —  if  he  wanted  such  an  estimate  as  a  basis  for  ^e  is 

limited  to  the  .set  of  potential  distributions  between  (1  '3,  2/3,  0)  anc 
(1/3  0,  2/3);  i.e.,  to  the  infinite  set  (1'3,X,  2/3  — X),  O^X^  2/3. 
Lacking  any  observations  on  the  number  of  yellow  or  black  balls,  he 
may  have  little  or  no  information  indicating  that  one  of  the  remain¬ 
ing  infinite  set  of  distributions  is  more  “likely,”  more  worthy  of 
attrition  than  any  other.  If  he  should  accumulate  some  observa¬ 
tions  in  the  form  of  small  sample  distributions,  this  set  of  reason¬ 
able’’  distributions  would  diminish,  and  a  particular  distribution 
might  gather  increasing  strength  as  a  candidate;  but  so  long  as  the 
samples  remain  small,  he  may  be  far  from  able  to  select  one  from  a 
number  of  distributions  as  a  unique  basis  for  decision. 

In  some  situations  where  two  or  more  probability  distributions 
over  the  .states  of  nature  seem  reasonable,  or  possible,  it  may  still  be 
possible  to  draw  on  different  sorts  of  evidence,  establishing  probability 
weights  in  turn  to  these  different  distributions  to  arrive  at  a  final, 
composite  distribution.  Even  in  our  examples,  it  would  be  mislead¬ 
ing  to  place  much  emphasis  on  the  notion  that  a  subject  has  no 
information  about  the  contents  of  an  urn  on  which  no  ob.servations 
have  been  made.  The  subjeeff  can  always  ask  liim.sclf:  “What  is  the 
likelihood  that  the  experimenter  has  rigged  this  urn.^’  Assuming  that 
he  has  what  proportion  of  red  balls  did  he  probably  set?  If  he  is  try¬ 
ing  to  trick  me,  how  is  he  going  about  it?  What  other  bets  is  he  going 
to  offer  me?  What  sort  of  results  is  he  after?”  If  he  has  had  a  lot  of 
experience  with  psychologiiail  tests  before,  he  may  be  able  to  bring  to 
bear  a  good  deal  of  information  and  intuition  that  seems  relevant  to 
the  problem  of  weighting  the  different  hypotheses,  the  alternative 
reasonable  proliability  distributions.  In  the  end,  these  weights,  and 
tlie  resulting  composite  probabilitii's,  may  or  may  not  be  equal  for 
the  different  possibilities.  In  our  examples,  actual  subjects  do  teiu 
to  be  indifferent  between  betting  on  red  or  black  in  the  unobserved 
urn  in  the  first  case,  or  between  betting  on  yellow  or  black  in  the 
.second  This  need  not  at  all  mean  that  they  felt  “completely  igno- 
mnt”  or  that  they  could  think  of  no  reason  to  favor  one  or  the  other; 
it  does  indicate  that  the  reasons,  if  any,  to  lavor  one  or  the  other 
balanced  out  subjectively  so  that  the  possibilities  entered  into  their 
final  decisions  weighted  equivalently. 
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Let  Us  assume,  for  ])urposes  of  tliscussiou,  that  an  individual  can 
always  assign  relative  weights  to  alternative  probability  ilistribiitions 
reflecting  the  relative  support  given  by  his  information,  experience 
and  intuition  to  these  rival  hypotlieses.  riiis  implies  that  he  can 
always  assign  relative  likelihoods  to  the  states  of  nature.  But  how 
does  he  act  in  the  presence  of  his  uncertainty?  d'he  answer  to  that 
may  depend  on  another  sort  of  judgment,  about  the  reliability,  credi¬ 
bility,  or  ade(iuacy  of  his  information  (including  his  relevant  experi¬ 
ence,  advice  ami  intuition)  as  a  whole:  not  about  the  relative  support 
it  may  give  to  one  hypothesis  as  opposed  to  another,  but  about  its 
ability  to  lend  support  to  any  hypothesis  at  all. 

If  all  the  information  about  the  events  in  a  set  of  gambles  were 
in  the  form  of  sample-distributions,  then  ambiguity  might  be  closely 
related,  inversely,  to  the  size  of  the  sample.®  But  sample-size  is  not 

8.  See  Chipinan,  op.  cit.,  pp.  75,  9.3.  Chipman’s  important  work  in  this 
area,  done  indeiiendently  and  largely  prior  to  mine,  is  not  discussp<i  here  since  it 
embodies  a  stochastic  theory  of  choice;  its  s|)irit  is  otherwise  closely  similar  to  that 
of  the  present  approach,  and  his  e.xperimental  results  are  both  pertinent  and 
favorable  to  the  hypotheses  below  (though  Chiiunan’s  inferences  are  somewhat 
different). 

See  also  the  CQmmonts  by  N.  Georgescu-Uoegen  on  notion  of  “credibility,” 
a  concept  ideid.ical  to  “ambiguity”  in  this  i)a])er:  “The  Nature  of  Kxpectation 
and  Uncertainty,”  in  Expectations,  V ncertainhj ,  and  Business  Behavior,  ed.  Mary 
Bowman,  Social  Science  Research  Council  (Now  York,  Itl.'iS),  pp.  24-26;  and 
“Choice,  Expectations  and  Measurability,”  this  Journal,  LXVIII  (Nov.  1954), 
527-30.  These  highly  pertinent  articles  came  to  my  attention  only  after  this 
paper  had  gone  to  the  printer,  allowing  no  space  for  comment  here. 

a  universally  useful  index  of  this  factor.  Information  about  many 
events  cannot  be  conveniently  described  in  terms  of  a  sample  dis¬ 
tribution;  moreover,  sample-size  seems  to  focus  mainly  on  the  quan¬ 
tity  of  information.  “Ambiguity”  may  be  high  (and  the  confidence 
in  any  particular  estimate  of  probabilities  low)  even  where  there  is 
ample  quantity  of  information,  when  there  are  cpiestions  of  reliability 
and  relevance  of  information,  and  particularly  where  there  is  con¬ 
flicting  opinion  and  evidence. 

This  judgment  of  the  ambiguity  of  one’s  information,  of  the 
over-all  credibility  of  one’s  composite  estimates,  of  one’s  confidence 
in  them,  cannot  be  expre.ssed  in  terms  of  relative  likelihoods  or  events 
(if  it  could,  it  would  simply  affect  the  final,  compound  probabilities). 
Any  scrap  of  evidence  bearing  on  relative  likelihood  should  already 
be  represented  in  those  estimates.  But  having  exploited  knowledge, 
guess,  rumor,  assumption,  advice,  to  arrive  at  a  final  judgment  that 
one  event  is  more  likely  than  another  or  that  they  are  equally  likely, 
one  can  still  stand  back  from  this  process  and  ask:  “How  much,  in 
the  end,  is  all  this  worth?  How  much  do  I  really  know  about  the 
problem?  How  firm  a  basis  for  choice,  for  appropriate  decision  and 
action,  do  I  have?”  The  answer,  “I  don’t  know  very  much,  and  I 
can’t  rely  on  that,”  may  sound  rather  familiar,  even  in  connection 
with  markedly  unequal  estimates  of  relative  likelihood.  If  “com¬ 
plete  ignorance”  is  rare  or  nonexistent,  “considerable”  ignorance  is 
surely  not. 

Savage  him.self  alludes  to  this  sort  of  judgment  and  notes  as  a 
difficulty  with  his  approach  that  no  recognition  is  given  to  it : 

there  seem  to  be  some  probability  relations  about  which  we  feel  relatively 
“sure”  as  compared  with  others.  .  .  The  notion  of  “sure”  and  “unsure”  intro¬ 
duced  here  is  vague,  and  my  complaint  is  precisely  that  neither  the  theory  of 
personal  probability,  as  it  is  developed  in  this  book,  nor  any  other  device  known 
to  me  renders  the  notion  less  vague.  .  .  A  second  difficulty,  perhaps  closely  asso¬ 
ciated  with  the  first  one,  stems  from  the  vagueness  associated  with  judgments  of 
the  magnitude  of  personal  probability.^ 

Knight  asserts  what  Savage’s  approach  tacitly  denies,  that  such 
overall  judgments  may  influence  decision: 

The  action  which  follows  u])on  an  opinion  depends  as  much  upon  the  amount  of 
confidence  in  that  opinion  as  it  does  upon  the  favorableness  of  the  opinion  itself 
.  Fidelity  to  the  actual  psychology  of  the  situation  requires,  we  must  insist, 
recognition  of  these  two  separate  exercises  of  judgment,  the  formation  of  an 
estimate  and  the  estimation  of  its  value.' 


9.  Savage,  op.  cit.,  pp.  57-58,  .59.  Savage  later  goes  so  far  as  to  suggest  [op. 
cit.,  pp.  168-69)  that  the  “aura  of  vagueness”  attached  to  many  judgments  of 
personal  probability  might  lead  to  systematic  violations  of  his  axioms  although 
the  decision  rule  he  discusses  as  alternative  —  minimaxing  regret  —  cannot,  as 
mentioned  in  footnote  7  on  p.  0.3  yabove,  account  for  the  behavior  in  our  examples. 

1.  Knight,  op.  cit.,  p.  227. 

Let  US  imagine  a  situation  in  which  so  many  of  the  probability 
judgments  an  individual  can  bring  to  bear  upon  a  particular  problem 
are  either  “vague”  or  “unsure”  that  his  confidence  in  a  particular 
assignment  of  probabilities,  as  opposed  to  some  other  of  a  set  of 
"reasonable”  distributions,  is  very  low.  We  may  define  this  as  a 
situation  of  high  ambiguity.  The  general  proposition  to  be  explored 
below  is  that  it  is  precisely  in  situations  of  this  sort  that  self-consistent 
behavior  violating  the  Savage  axioms  may  commonly  occur. 

Ambiguity  is  a  sulijective  variable,  but  it  should  be  possible  to 
identify  “objectively”  some  situations  likely  to  present  high  ambi¬ 
guity,  by  noting  situations  where  available  information  is  scanty  or 
obviously  unreliable  or  highly  conflicting;  or  where  expressed  expecta¬ 
tions  of  different  individuals  differ  widely;  or  where  expressed  con¬ 
fidence  ill  estimates  tends  to  be  low.  Thus,  as  compared  with  the 
effects  of  familiar  production  decisions  or  well-known  random  processes 
(like  coin  flipping  or  roulette),  the  results  of  Re.search  and  Develop¬ 
ment,  or  the  performance  of  a  new  President,  or  the  tactics  of  an 
unfamiliar  opponent  are  all  likely  to  appear  ambiguous.  This  would 
suggest  a  broad  field  of  application  for  the  proposition  above. 

In  terms  of  Shackle’s  cricket  example:  Imagine  an  American 
observer  who  had  never  heard  of  cricket,  knew  none  of  the  rules  or 
the  method  of  scoring,  and  had  no  clue  as  to  the  past  record  or  present 
prospects  of  England  or  Australia.  If  he  were  confronted  with  a  set 
of  side  bets  as  to  whether  England  would  bat  first  —  this  to  depend 
on  the  throw  of  a  die  or  a  coin  —  I  expect  (unlike  Shackle)  that  he 
would  be  found  to  obey  Savage’s  axioms  pretty  closely,  or  at  lea.st, 
to  want  to  obey  them  if  any  discrepancies  were  pointed  out.  Yet  I 
should  not  be  surprised  by  (luite  different  behavior,  at  odds  with  the 
axioms,  if  that  particular  ob.server  were  forced  to  gamt)le  heavily  on 
the  proposition  that  England  would  win  the  match. 

Let  us  suppose  that  an  individual  must  choose  among  a  certain 
set  of  actions,  to  whose  po.ssible  consequences  we  can  assign  “von 
Neumann-Morgensteru  utilities”  (reflecting  the  fact  that  in  choosing 
among  some  set  of  “unambiguous”  gambles  involving  other  events 
and  these  same  outcomes,  he  obeys  the  Savage  axioms).  We  shall 
suppose  that  l)y  comi)ounding  various  prol)ability  judgments  of  vary¬ 
ing  degrees  of  reliability  he  can  eliminate  certain  probability  dis¬ 
tributions  over  the  states  of  nature  as  “unreasonable,”  assign  weights 
to  others  and  arrive  at  a  comi)osite  “estimated”  distribution  y°  that 
represents  all  his  available  information  on  relative  likelihoods.  But 
let  us  further  suppo.se  that  the  situation  is  ambiguous  for  him.  Out 
of  the  set  T  of  all  po.ssible  distributions  there  remaiiis  a  set  Y"  of 
distributions  that  still  seem  “reasonable,”  reflecting  judgments 
that  he  “might  almost  as  well”  have  made,  or  that  his  information  — 
perceived  as  scanty,  unreliable,  ambiguous  —  does  not  permit  him 
confidently  to  rule  out. 
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In  choosing  between  two  actions,  I  and  II,  he  can  compute  their 
expected  utilities  in  terms  of  their  pay-offs  and  tlie  “estimated” 
probability  distril)ntion  y" .  If  the  likelihoods  of  the  events  in  (jnestion 
were  as  unambiguous  as  those  in  the  situations  in  which  his  von 
Nenmann-lNIorgenstern  utilities  were  originally  measured,  this  would 
be  the  end  of  the  matter;  these  pay-offs  embody  all  his  attitudes 
toward  “risk,  '  and  expected  values  will  correspond  to  his  actual 
preferences  among  “risky”  gambles.  But  in  this  case,  where  his  final 
assignment  of  probabilities  is  less  confident,  that  calculation  may 
leave  him  uneasy.  “8o  I  has  a  lower  expectation  than  II,  on  the 
basis  of  these  estimates  of  probabilities,”  he  may  reflect;  “How  much 
does  that  tell  me?  That’s  not  much  of  a  reason  to  choo.se  II.” 

In  this  state  of  mind,  searching  for  additional  grounds  for  choice, 
he  may  try  new  criteria,  ask  new  questions.  For  any  of  the  proba¬ 
bility  distributions  in  the  “reasonably  possible”  set  F°,  he  can  com¬ 
pute  an  expected  value  for  each  of  his  actions.  It  might  now  occur 
to  him  to  ask:  “What  might  happen  to  me  if  my  best  estimates  of 
likelihood  don’t  apply?  What  is  the  worst  of  the  reasonable  expecta¬ 
tions  of  pay-off  that  1  might  associate  with  action  I?  With  action  11?” 
He  might  find  that  he  could  answer  this  question  about  the  lower 
limit  of  the  reasonable  expectations  for  a  given  action  much  more 
confidently  than  he  could  arrive  at  a  single,  “best  guess”  expectation; 
the  latter  estimate,  he  might  suspect,  might  vary  almost  hourly 
with  his  mood,  whereas  the  former  might  look  much  more  solid, 
almost  a  “fact,”  a  piece  of  evidence  definitely  worth  considering  in 
making  his  choice.  In  almost  no  ca,ses  (excluding  “complete  igno¬ 
rance”  as  unrealistic)  will  the  only  fact  worth  noting  about  a  pro¬ 
spective  action  be  its  “security  level”:  the  “worst”  of  the  expecta¬ 
tions  associated  with  reasonably  po.ssible  probability  distributions. 
To  choose  on  a  “luaximin”  criterion  alone  would  be  to  ignore  entirely 
those  probability  judgments  for  which  there  is  evidence.  But  in 
situations  of  high  ambiguity,  .such  a  criterion  may  appeal  to  a  con¬ 
servative  person  as  de.serviug  some  weight,  when  interrogation  of  his 
own  subjective  estimates  of  likelihood  has  failed  to  disclose  a  set  of 
estimates  that  compel  exclusive  attention  in  his  decision-making. 

If,  in  the  end,  such  a  person  chooses  action  I,  he  may  explain: 

In  terms  of  my  best  estimates  of  probabilities,  action  I  has  almost  as  high  an 
expectation  as  action  II.  But  if  my  best  guesses  should  be  rotten,  which  wouldn’t 
surprise  me,  action  I  gives  me  better  protection;  the  worst  expectation  that  looks 
reasonably  possible  isn’t  much  worse  than  the  “best  guess”  expectation,  whereas 
with  action  II  it  looks  possible  that  my  expectation  could  really  be  terrible. 

An  advocate  of  the  Savage  axioms  as  normative  criteria,  fore¬ 
seeing  where  such  reasoning  will  lead,  may  interject  in  exasperation: 

Why  are  you  double-counting  the  “worst”  possibilities?  They’re  already  taken 
into  account  in  your  over-all  estimates  of  likelihoods,  weighted  in  a  reasoned, 
realistic  way  that  represents  —  by  your  own  claim  —  your  best  judgment.  Once 
you’ve  arrived  at  a  probability  distriljution  that  reflects  everything  you  know 
that’s  relevant,  don’t  fiddle  around  with  it,  use  it.  Stop  asking  irrelevant  ques¬ 
tions  and  whining  about  how  little  you  really  know. 

But  this  may  evoke  the  calm  reply: 

It’s  no  use  bullying  me  into  taking  action  II  by  flattering  my  “best  judgment.”  I 
know  how  little  that’s  based  on;  I’d  back  it  if  we  were  betting  with  pennies,  but 
I  want  to  know  some  other  things  if  the  stakes  are  important,  and  “How  much 
might  I  expect  to  lose,  without  being  unreasonable?”  just  strikes  me  as  one  of 
those  things.  As  for  the  reasonableness  of  giving  extra  weight  to  the  “bad” 
likelihoods,  my  test  for  that  is  pragmatic;  in  situations  where  I  really  can’t  judge 
confidently  among  a  whole  range  of  possible  distributions,  this  rule  steers  me 
toward  actions  w'hose  expected  values  are  relatively  insensitive  to  the  particular 
distribution  in  that  range,  without  giving  up  too  much  in  terms  of  the  “best 
guess”  distribution.  That  strikes  me  as  a  sensible,  conservative  rule  to  follow. 
What’s  wrong  with  it? 

“What’s  wrong  with  it”  is  that  it  will  lead  to  violations  of 
Savage’.s  Postulate  2,  and  will  make  it  impossible  for  an  observer  to 
describe  the  subject’s  choices  as  though  he  were  maximizing  a  linear 
combination  of  pay-offs  and  probabilities  over  events.  Neither  of 
these  considerations,  even  on  reflection,  may  pose  to  our  conservative 
subject  overwhelming  imperatives  to  change  his  behavior.  It  will 
not  be  true  that  this  behavior  is  erratic  or  unpredictable  (we  shall 
formalize  it  in  terms  of  a  decision  rule  below),  or  exhibits  intransi¬ 
tivities,  or  amounts  to  “throwing  away  utility”  (as  would  be  true, 
for  example,  if  it  led  him  occasionally  to  choose  strategies  that  were 
strongly  “dominated’’  by  others).  There  is,  in  fact,  no  obvious  basis 
for  asserting  that  it  will  lead  him  in  the  long  run  to  worse  outcomes 
than  he  coidd  expect  if  he  rever.sed  some  of  his  preferences  to  conform 
to  the  Savage  axioms. 

Another  person,  or  this  same  person  in  a  different  situation, 
might  have  turned  instead  or  in  addition  to  some  other  criteria  for 
guidance.  One  might  ask,  in  an  ambiguous  situation:  “What  is  the 
best  expectation  I  might  a.ssociate  with  this  action,  without  being 
unreasonable?”  Or:  “Wluit  is  its  average  expectation,  giving  all  the 
reasonably  possible  distributions  equal  weight?”  The  latter  con¬ 
sideration  would  not,  as  it  happens,  lead  to  behavior  violating  the 
Savage  axioms.  The  former  would,  in  the  same  fashion  though  in 
the  opposite  direction  as  the  “maximin”  criterion  dkscussed  above; 
indeed,  this  “maximaxing”  consideration  could  generate  the  minority 
behavior  of  tho.se  who,  in  our  urn  exami)le,  prefer  II  to  I  and  III  to  IV. 
Both  these  patterns  of  behavior  could  be  described  by  a  decision  rule 
similar  to  the  one  below,  and  their  respective  rationales  might  be 
similar  to  that  given  above.  But  let  us  continue  to  focus  on  the 
particular  pattern  discussed  above,  becau.se  it  seems  to  predominate 
empirically  (at  least,  with  respect  to  our  examples)  and  becau.se  it 
most  frofiuently  corresponds  to  advice  to  be  found  on  decision-making 
in  ambiguous  situations. 
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In  reaching  his  decision,  the  relative  weight  that  a  conservative 
person  will  give  to  the  iiuestion,  “What  is  the  worst  expectation  that 
might  appear  reasonable?”  will  depend  on  his  confidence  in  the  judg¬ 
ments  that  go  into  his  estimated  probability  distribution.  The  less 
confident  he  is,  the  more  he  will  sacrifice  in  terms  of  estimated 
expected  pay-off  to  achieve  a  given  increase  in  “security  level”;  the 
more  confident,  the  greater  increase  in  “security  level”  he  would 
demand  to  compensate  for  a  given  drop  in  estimated  expectation 
This  implies  that  “trades”  are  possible  between  security  level  and 
estimated  expectation  in  his  preferences,  and  that  does  seem  to 
correspond  to  observed  responses.  Many  subjects  will  still  prefer 
to  bet  on  R„  than  R,  in  our  first  example  even  when  the  proportion 
of  red  to  black  in  Urn  II  is  lowered  to  49:51,  or  will  prefer  to  bet  on 
red  than  on  yellow  in  the  second  example  even  when  one  red  ball  is 
removed  from  the  urn.  But  at  some  point,  as  the  “unambiguous 
likelihood  becomes  increasingly  unfavorable,  their  choices  will 
switch.^ 


2.  Tills  contradicts  the  assertions  by  Chipman  (op.  ciL,  R  and  ^<*0^- 
scu-Roegen  (“Choice,  Expoctatians  and  Measurability,  pp.  o2i  30),  and  i 
Nature  of  hixpectatiou  and  Uncertainty,”  p.  2,5)  that  uidivi.luals  order^uncer- 
tainty-situatious  lexicographically  in  terms  '^stiniatcd  expectation  and  ^ 
bility”  (ambiguity);  ambiguity  appears  to  inHuence  choice  even  when  cstim.ited 
expectations  are  not  equivalent. 


Assuming,  purely  for  simplicity,  that  the.se  factors  enter  into  his 
decision  rule  in  linear  combination,  we  can  denote  by  p  his  degree  o 
confidence,  in  a  given  state  of  information  or  ambiguity,  in  the  esti¬ 
mated  distribution  ^ which  in  turn  reflects  all  of  his  judgments  on 
the  relative  likelihood  of  distributions,  including  judgments  of  ecjual 
Q  rh  K  '  likelihood.  Let  min,,  be  the  minimum  expected  piw-off  to  an  act  x 
T  ^  '  as  the  probability  distribution  ranges  over  the  set  K";  let  est„  be  the 

expected  my-off  to  the  act  x  corresponding  to  the  estimated  dis¬ 
tribution 

The  simplest  decision  rule  reflecting  the  above  considerations 
would  be;^  Associate  with  each  x  the  index. 


3  This  rule  is  based  upon  the  concept  of  a  “restricted  Bayes  solution 
developed  by  .J.  L.  Hodges.  .Jr.,  and  E.  L.  Lehmann  (  The  Uses  of  1  ''Pvioiw 
Experience  in  Reaching  Statistical  Decision,”  Annals  of 

Vol  23  (Sept.  1952),  pp.  39(1-407.  The  discussion  throughout  i^’ection  m  of  this 
paper  derives  heavily  from  the  Hodges  and  Lehmann  argument,  although  their 
anproach  is  motivated  and  rationalized  somewhat  dilferently. 

^  See  also  L  Hurwicz.  “Some  Specification  Problems  and  Applications  to 
Econometric  Models,”  Ecmiometnca,  Vol.  19  (July  1951).  PP-  343-44  (abstract  . 
This  deals  with  the  same  sort  of  problem  and  presents  a  generalized  Bayes-mini- 
max  prmciple”  equivalent,  in  more  general  form,  to  the  decision  rii  e  l  proposed 
in  an  earlier  presentation  of  this  paper  (December,  1900),  but  both 
the  crucial  notions  developed  in  the  Hodges  and  Lehmann  approach  of  a  best 
estimate”  distribution  and  a  “confidence”  parameter  p. 


P  .  est„  -b  (1  -  p)  ■  miiL 

Choose  that  a.ct  with  the  highest  index.  r. 

An  eciuivaleut  formulation  would  be  the  following,  where  is 
the  estimated  probability  vector,  ijT'  the  probability  vector  m 
corresponding  to  action  x;  Associate  with  each  x  the  index: 

[p  .  P+  (1  -  p)  yTKx) 

Choose  that  act  with  the  highest  index. 

In  the  case  of  the  red,  yellow  and  black  balls,  supposing  no 
samples  and  no  explicit  information  except  that  1/3  of  the  balls  are 
red  many  subjects  might  lean  toward  an  estimated  distribution  of 
(1/3  1  '3,  1/3)  ( if  not  from  “ignorance,”  then  from  counterbalaiicmg 
considerations.  But  many  of  these  would  find  the  situation  ambigu¬ 
ous'  for  them  the  “reasonable”  distributions  Y°  might  be  all  those 
beUveen  (1/3  2/3,  0)  and  (1/3,  0,  2/3).  Assuming  for  purposes  of 
illustration  p  =  1 /4  (T“,  if,  X  and  p  are  all  subjective  data  to  be 
inferred  by  an  observer  or  supplied  by  the  individual,  depending  on 
whether  the  criterion  is  being  used  descriptively  or  for  convenient 
decision-making),  the  formula  for  the  index  would  be: 

•  est„  -b  M  miiH- 

The  relevant  data  (assigning  arbitrary  utility  values  of  6  and  0  to 
the  money  outcomes  $100  and  $0)  would  be: 

Red  Yellow  Black  Min„  Est^  Index 


I 

6 

0 

0 

2 

2 

2 

II 

0 

6 

0 

0 

2 

.5 

III 

6 

0 

6 

2 

4 

2.5 

IV 

0 

6 

6 

4 

4 

4 

A  person  conforming  to  this  rule  with  these  values  would  prefer  I  to 
II  and  IV  to  III,  in  violation  of  the  Sure-thing  Principle:  as  do  most 
people  ([iieried.  In  justifying  this  pattern  of  behavioi  he  might 
II  and  IV  to  III,  in  violation  of  the  Sure-thing  Principle:  as  do  mo.st 
reproduce  the  rationale  quoted  above  (g.v.) ;  but  most  verbal  explana¬ 
tions,  somewhat  less  articulately,  tend  to  be  along  these  lines. 

The  expected  pay-off  for  action  I  is  definite;  2.  The  risks  under  action  II  may 
be  no  greater,  but  I  know  what  the  risk  is  under  action  I  and  I  don’t  under 
action  II.  The  expectation  for  action  II  is  ambiguous,  it  might  be  better  or  it 
might  be  worse,  anything  from  0  to  4.  To  be  on  the  safe  side.  I’ll  assume  that  it’s 
closer  to  0;  so  action  I  looks  better.  By  the  same  token,  IV  looks  better  than 
III;  I  know  that  my  expected  pay-off  with  IV  is  4,  whereas  with  III  it  might  be  as 
low  as  2  (which  isn’t  compensated  by  the  chance  that  it  could  be  6). 

Leaving  the  advocate  of  the  Savage  axioms,  if  he  is  still  around 
to  hear  this,  to  renew  his  complaints  about  the  silliness  and  irrelevance 
of  such  considerations,  let  us  note  a  practical  consecjnence  of  the 
decision  rule  which  the  above  comment  brings  into  focus.  It  has 
already  been  mentioned  that  the  rule  will  favor  other  things  (such 
as  the  estimated  expectation)  being  roughly  eipial  actions  whose 
expected  value  is  less  sensitive  to  variation  of  the  proliability  dis¬ 
tribution  within  the  range  of  ambiguity.  Such  actions  may  fre¬ 
quently  be  those  definable  as  “status  quo  ’  or  pre.seut  behavioi 
strategies. 


EL 
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A  familiar,  ongoing  pattern  of  activity  may  he  snhject  to  con- 
.siderahle  uiuiortainty,  hut  tliis  nneertainty  i.s  more  apt  to  appear  in 
the  form  of  “risk”;  the  relation  between  given  state,s  of  nature  is 
known  precisely,  and  although  the  random  variation  in  the  state 
of  nature  which  “obtains”  may  be  considerable,  its  stochast  ic  i)roper- 
ties  are  often  known  confidently  and  in  detail,  (.\ctually,  this  confi¬ 
dence  may  be  .self-deceptive,  ba.sed  on  ignoring  some  treacherous 
possibilities;  nevertheless,  it  cmmmonly  (exists.)  In  contrast,  the 
ambiguities  surroundiug  the  outcome  of  a  projjo.sed  innovation,  a 
departure  from  current  strategy,  may  be  much  more  noticeable. 
Different  sorts  of  events  are  relevant  to  its  outcome,  and  their  likeli¬ 
hoods  must  now  be  estimated,  often  with  little  evidence  or  prior 
expertise;  and  the  effect  of  a  given  state  of  nature  upon  the  outcome 
of  the  new  ac.tion  may  itself  be  in  question.  Its  variance  may  not 
appear  any  higher  than  that  of  the  familiar  action  when  computed 
on  the  basis  of  “best  estimates”  of  the  probabilities  involved,  yet 
the  meaningfulness  of  this  calculation  may  be  subject  to  doubt.  The 
decision  rule  discussed  will  not  preclude  choosing  such  an  act,  but  it 
will  definitely  bias  the  choice  away  from  such  ambiguous  ventures 
and  toward  the  strategy  with  “known  risks.”  Thus  the  rule  is 
“conservative”  in  a  sen.se  more  familiar  to  everyday  conversation 
than  to  statistical  decision  theory;  it  may  often  favor  traditional  or 
current  strategies,  even  perhaps  at  high  risk,  over  innovations  whose 
consequences  are  undeniably  ambiguous.  This  property  may  recom- 
meiul  it  to  some,  discredit  it  with  others  (some  of  whom  might  prefer 
to  reverse  the  rule,  to  emphasize  the  more  hopeful  possibilities  in 
ambiguous  .situations);  it  does  not  seem  irrelevant  to  one’s  attitude 
toward  the  behavior. 

In  the  equivalent  formulation  in  terms  of  and  y°,  the  subject 
above  could  be  described  “as  though”  he  were  assigning  weights  to 
the  respective  pay-offs  of  actions  II  and  III,  whose  expected  values 
are  ambiguous,  as  follows  (assuming  y”  =  (1/3,  1/3,  1/3)  in  each 
case) : 

yr  p-/+(l-p)2/r 


II 


III 


Although  the  final  set  of  weights  for  each  .set  of  pay-offs  resemble 
probabilities  (they  are  positive,  sum  to  unity,  and  represent  a  linear 
combination  of  two  probability  distributions),  they  differ  for  each 
action,  since  will  depend  on  the  pay-offs  for  x  and  will  vary  for 
different  actions.  If  these  weights  were  interpreted  as  “probabili¬ 
ties,”  we  would  have  to  regard  the  subject’s  subjective  probabilities 
as  being  dependent  upon  his  pay-offs,  his  evaluation  of  the  outcomes. 
Thus,  this  model  would  be  appropriate  to  represent  cases  of  true 
pessimism,  or  optimism  or  wishfulness  (with  substituting  for 
7/™°).  However,  in  this  case  we  are  assuming  conservatism,  not 
pessimism;  our  subject  does  not  actually  expect  the  worst,  but  he 
chooses  to  act  “as  though*’  the  worst  were  somewhat  more  likely  than 
his  best  estimates  of  likelihood  would  indicate.  In  either  case,  he 
violates  the  Savage  axioms;  it  is  impossible  to  infer  from  the  result¬ 
ing  behavior  a  set  of  probabilities  for  events  independent  of  his  pay¬ 
offs.  In  effect,  he  “distorts”  his  best  estimates  of  likelihood,  in  the 
direction  of  increa.sed  emphasis  on  the  less  favorable  outcomes  and 
to  a  degree  depending  on  p,  his  confidence  in  his  best  estimate.^ 

4.  This  interpretation  of  the  behavior-pattern  contrasts  to  the  hypothesis 
or  decision  rule  advanced  by  Fellner  in  the  accompanying  article  in  this  sympo¬ 
sium.  Fellner  seems  unmistakably  to  be  dealing  with  the  same  phenomena  dis¬ 
cussed  here,  and  his  proposed  technique  of  measuring  a  person’s  subjective  prob¬ 
abilities  and  utilities  in  relatively  “unambiguous”  situations  and  then  using  these 
measurements  to  calibrate  his  uncertainty  in  more  ambiguous  environments 
seenas  to  me  a  most  valuable  source  of  new  data  and  hypotheses.  Moreover,  his 
descriptive  data  and  intuitive  conjectures  lend  encouraging  support  to  the  find¬ 
ings  reported  here.  However,  his  solution  to  the  problem  supposes  a  single  set  of 
weights  determined  independently  of  pay-offs  (presumably  corresponding  to  the 
“best  estimates”  here)  and  a“correction  factor,”  reflecting  the  degree  of  ambiguity 
or  confidence,  which  operates  on  these  weights  in  a  manner  independent  of  the 
structure  of  [>av-offs.  I  am  not  entirely  clear  on  the  behavioral  implications  of 
Fellner’s  moJef  or  the  decision  rule  it  implies,  but  in  view  of  these  properties  I 
am  doubtful  whether  it  can  account  adequately  for  all  the  behavior  discussed 
above. 

Not  only  doe.s  this  decision  model  account  for  “deviant”  behav¬ 
ior  in  a  particular,  ambiguous  situation,  but  it  covers  the  observed 
shift  in  a  subject’s  behavior  as  ambiguity  decreases.  Suppose  that  a 
sample  is  drawn  from  the  urn,  strengthening  the  confidence  in  the 
best  estimates  of  likelihood,  so  that  p  increases,  say,  to  The 

weights  for  the  pay-offs  to  actions  II  and  III  would  now  be: 

p  •  /  -t-  (1-p)  yr 


and  the  over-all  index  would  be:  Index 

I  2 

II  1.5 

III  3.5 

IV  4 

In  other  words,  the  relative  inffuence  of  the  consideration,  “What  is 
the  worst  to  be  expected?”  upon  the  comijarison  of  actions  is  lessened. 
The  final  weights  approach  closer  to  the  “best  estimate”  values,  and 
I  and  II  approach  closer  to  indifference,  as  do  III  and  IV.  This 
latter  aspect  might  show  up  behaviorally  in  the  amount  a  subject  is 
willing  to  pay  for  a  given  bet  on  yellow,  or  on  (red  or  black),  in  the 
two  situations. 

In  the  limit,  as  ambiguity  diminishes  for  one  reason  or  another 
and  p  approaches  1,  the  estimated  distribution  will  come  increa.s- 
ingly  to  dominate  decision.  With  confidence  in  the  best  estimates 
high,  behavior  on  the  basis  of  the  i)roi)osed  decision  rule  will  roughly 
conform  to  the  Savage  axioms,  and  it  would  be  i)ossible  to  infer  the 
estimated  ]jrobabilities  from  observed  choices.  But  prior  to  this, 
a  large  number  of  information  states,  distinguishalde  from  each  other 
and  all  far  removed  from  “complete  ignoranc.e,”  might  all  be  suffi¬ 
ciently  ambiguous  as  to  lead  many  decision-makers  to  conform  to  the 
above  decision  rule  with  p  <  1,  in  clear  violation  of  the  axioms. 
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Are  they  foolish?  It  is  not  the  object  of  this  paper  to  judge 
that.  I  have  been  concerned  rather  to  advance  the  testalde  proposi¬ 
tions:  (1)  certain  information  states  can  be  meaningfully  identified 
as  highly  ambiguous;  (2)  in  these  states,  many  reasonable  people 
tend  to  violate  the  Savage  axioms  with  respect  to  certain  choices; 
(3)  their  behavior  is  deliberate  and  not  readily  reversed  upon  reflec¬ 
tion;  (4)  certain  patterns  of  “violating”  behavior  can  be  distinguished 
and  described  in  terms  of  a  specified  decision  rule. 

If  these  propositions  should  prove  valid,  the  question  of  the 
optimality  of  this  behavior  would  gain  more  interest.  The  mere  fact 
that  it  conflicts  with  certain  axioms  of  choice  that  at  first  glance 
appear  reasonable  does  not  seem  to  me  to  foreclose  this  question, 
empirical  re.search,  and  even  preliminary  speculation,  about  the 
nature  of  actual  or  “successful”  decision-making  under  uncertainty 
is  still  too  young  to  give  us  confidence  that  these,  axioms  are  not 
abstracting  away  from  vital  considerations.  It  would  seem  incautious 
to  rule  peremptorily  that  the  people  in  question  should  not  allow 
their  perception  of  ambiguity,  their  unease  with  their  best  estimates 
of  probability,  to  influence  their  decision:  or  to  assert  that  the 
manner  in  which  they  respond  to  it  is  against  their  long-run  interest 
and  that  they  would  be  in  some  sense  better  olf  it  they  should  go 
against  their  deep-felt  preferences.  If  their  rationale  for  their  deci¬ 
sion  behavior  is  not  unicpiely  compelling  (and  recent  discussions  with 
T.  Schelling  have  raised  (luestions  in  my  mind  about  it),  neither,  it 
seems  to  me,  are  the  counterarguments.  Indeed,  it  seems  out  of  the 
question  summarily  to  judge  their  behavior  as  iiiational.  I  am 
included  among  them. 

In  any  case,  it  follows  from  the  propositions  above  that  for  their 
behavior  in  the  situations  in  ([uestion,  the  Bayesian  or  Savage 
api)roach  gives  wrong  predictions  and,  by  their  lights,  bad  advice. 
They  act  in  conflict  with  the  axioms  deliberately,  without  apology, 
because  it  seems  to  them  the  sensible  way  to  behave.  -Are  they 
clearly  mistaken? 
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Ch  five. 


On  the  urn  experiments :  there  is  a  problem  here ,  I  believe . 
I  can't  formulate  the  problem  well  enough  to  try  to  do  so,  here. 
But  I  do  suggest  that  you  understate  rather  than  overstate  tka; 


specifically,  (1)  why  not  delete  the  parenthetical  remark  on  p  1, 

"It  should  not  be  too  hard  to  imagine  conditions  that  would  have  this 

first  complete 

effect";  and  (2i)  also  delete  the  second  sentence  in  the/para  on  p 

the  sentence  starting  "The  stipulation  at  the  outset...." 

I  gave  this  test  to  Bill  Taylor,  who,  after  it  was  all  over. 

told  us  of  a  remark  by  Lamb,  which  ran  something  like  this:  "I 

won ' t  agree  that  two  and  two  make  f  our  until  you  tell  me  what  you 

propose  to  make  of  it." 
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